On  Organizational  Adaptation  via  Dynamic  Process  Selection 


Holly  A.  H.  Handley  and  Alexander  H.  Levis* 

System  Architectures  Laboratory 
C3I  Center,  MSN  4D2 
George  Mason  University 
Fairfax,  VA  22030 

Abstract 

Three  different  strategies  are  identified  for  organizational  adaptation,  including  dynamic  process 
selection.  An  executable  organizational  model  composed  of  individual  models  of  a  five  stage 
interacting  decision  maker  is  used  to  evaluate  the  effectiveness  of  the  different  adaptation 
strategies  on  organizational  performance.  The  concept  of  entropy  is  used  to  calculate  the  total 
activity  value,  a  surrogate  for  decision  maker  workload,  based  on  the  functional  partition  and  the 
adaptation  strategy  being  implemented.  The  individual  decision  maker’s  total  activity  is 
monitored,  as  overloaded  decision  makers  constrain  organizational  performance.  A  virtual 
experiment  was  conducted;  organizations  implementing  local  and  global  adaptation  strategies 
were  compared  to  a  control  organization  with  no  adaptation.  The  level  of  tolerance  of  the 
organization,  the  workload  limit  based  on  the  concept  of  the  bounded  rationality  constraint,  was 
used  to  determined  when  a  decision  maker  was  overloaded:  the  limiting  effect  of  the  workload 
on  performance.  The  timeliness  of  the  organization’s  response  was  used  in  order  to  evaluate 
organizational  output  as  a  function  of  adaptation  strategy. 

1.  Introduction 

An  organization  can  be  considered  a  system  composed  of  individual  decision  makers.  The 
organization  has  a  set  of  tasks  that  it  must  do  to  accomplish  its  mission.  A  task  is  such  that  it  is 
too  complex  for  a  single  decision  maker  to  accomplish  alone,  however  the  task  can  be 
decomposed  into  functions  that  can  be  completed  by  the  individual  decision  makers.  A  task 
graph  is  developed  that  represents  the  information  pattern  between  these  functions  necessary  to 
complete  the  task.  This  task  graph  is  referred  to  as  a  process:  the  series  of  functions  required  for 
each  task  to  produce  a  response.  When  changes  occur,  either  within  the  organization  or  its 
environment,  to  such  an  extent  that  the  organization  is  no  longer  performing  adequately  or  can 
not  perform  in  its  current  configuration,  the  organization  is  forced  to  adapt,  or  reconfigure  itself, 
in  response  to  these  changing  circumstances,  while  still  continuing  to  operate. 

Three  different  strategies  for  organizational  adaptation  can  be  identified:  none,  local,  and  global. 
In  some  cases,  no  changes  in  the  organizational  structure  may  be  the  appropriate  response  to 
change.  Since  any  type  of  change  imposes  an  overhead  on  the  organization,  for  example  having 
more  than  one  decision  maker  available  for  a  single  function,  an  organization  that  does  not 
accommodate  change  can  be  considered  a  “low  cost”  organization;  the  workload  of  the 
individual  decision  makers  is  lower  than  in  organizations  that  can  adapt.  Alternatively,  local 
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changes  within  the  organizational  structure  can  be  made  by  identifying  secondary  or  backup 
decision  makers  allowing  tasks  or  resources  to  be  transferred  among  the  decision  makers 
[Serfaty  and  Entin,  1995;  Perdu  and  Levis,  1998].  This  strategy  maintains  the  process  or 
sequence  of  functions  necessary  to  complete  the  task,  When  the  decision  maker  who  has  primary 
responsibility  for  a  function  is  over  loaded,  the  back  up  decision  maker  for  that  function  is 
selected  to  decrease  the  primary  decision  maker’s  workload.  In  order  for  this  method  to  be 
effective,  there  must  be  alternative  decision  makers  available  who  are  able  to  complete  the  same 
function.  This  additional  information  on  secondary  decision  makers  is  the  overhead  associated 
with  local  adaptation  and  can  be  shown  to  increase  a  decision  maker’s  workload. 

By  releasing  the  constraint  on  maintaining  a  fixed  process  associated  with  a  task,  a  third 
adaptation  strategy  can  be  implemented  by  identifying  alternative  processes  capable  of 
completing  the  same  task.  This  global  adaptation  represents  a  change  in  the  organization’s 
strategy  for  accomplishing  a  given  task  [Handley,  1999].  When  the  organizational  output  no 
longer  meets  the  performance  requirements  of  a  task,  a  new  process  is  implemented  to  complete 
that  type  of  task.  For  this  method  to  be  effective,  there  must  be  alternative  task  processes 
identified.  This  information  on  alternative  process  is  the  overhead  associated  with  global 
adaptation  and  can  also  be  shown  to  increase  the  decision  maker’s  workload.  While  the  local 
strategy  advocates  offsetting  individual  decision  maker’s  workload  while  maintaining  the  same 
task  process,  the  global  strategy  implies  that  selecting  a  new  process  will  result  in  improved 
performance.  Carley  [1998]  discriminates  between  adaptation  at  the  strategic  and  at  the 
operational  levels. 

This  paper  reviews  a  model  with  which  to  evaluate  the  performance  of  an  organization  under 
different  adaptation  strategies,  which  in  turn  induce  different  workload  overhead  [Handley, 
1999].  The  decision  maker’s  total  activity,  as  he  receives  and  completes  functions,  is  monitored 
to  determine  his  workload  status.  The  organizational  output  is  also  monitored.  An  executable 
model  of  the  organization  was  created  as  a  Colored  Petri  net,  a  discrete  event  system  modeling 
tool  which  captures  the  precedence  relations  and  structural  interactions  of  concurrent  and 
asynchronous  events.  The  prominent  component  of  the  organizational  model  is  the  decision 
maker.  The  five  stage  interacting  decision  maker  model  of  Levis  [1992]  was  used  as  the  basis  of 
the  decision  maker  model.  Different  roles  for  the  five  stage  decision  maker  model  were 
identified  by  noting  the  allowable  input  and  output  patterns  required  for  different  functions. 
These  roles  were  then  folded  back  into  one  model  and  implemented  as  a  Colored  Petri  net,  a  sub 
page  in  the  hierarchical  organizational  model.  Stored  within  the  model  is  an  execution  table, 
which  returns  the  output  data  value  for  an  input  data  value  for  a  given  function;  this  represents 
the  algorithm  implementation  of  each  function.  Also  included  in  the  model  are  a  process 
rulebase,  which  indicates  the  next  function(s)  in  a  specified  process,  and  a  next  decision  maker 
table,  which  identifies  which  decision  maker  can  perform  the  next  function(s).  There  is  also  a 
backup  decision  maker  table  that  provides  secondary  decision  maker  information  for  overloaded 
primary  decision  makers. 

The  algorithms  within  each  stage  of  the  model  can  be  used  to  calculate  the  total  activity  of  the 
decision  maker,  a  surrogate  for  the  decision  maker’s  workload.  Since  the  adaptation  strategy 
being  implemented  activates  different  algorithms  in  the  model,  different  adaptation  strategies 
result  in  different  total  activity  values  for  the  decision  makers.  While  a  previous  study  of  local 


adaptation  limited  the  total  number  of  functions  a  decision  maker  could  accept  in  order  to  avoid 
overloading  [Perdu  and  Levis,  1998],  using  total  activity  as  an  indicator  of  cognitive  workload 
provides  a  better  indicator  of  the  decision  maker’s  status  based  on  his  functional  abilities  and  the 
adaptation  strategy;  it  is  the  cognitive  limitation  of  the  decision  makers  that  manifests  itself  as  a 
bound  on  the  organizational  performance.  Under  different  levels  of  tolerance,  the  overhead  for 
maintaining  the  adaptation  strategy,  as  indicated  by  decision  maker  workload,  may  limit 
organizational  performance. 

The  consequences  of  the  different  adaptation  strategies  were  illustrated  by  conducting  a  virtual 
experiment  which  simulates  the  organizational  model  under  three  different  adaptation  strategies: 
none,  local,  and  global.  Data  from  a  recent  subject  experiment  was  used  to  populate  the  model 
and  create  input  scenarios  of  tasks  for  the  organizational  model  to  respond  to;  four  task  processes 
and  two  alternative  organizational  structures  were  used.  Stress  on  the  organization  was  induced 
by  increasing  the  interarrival  time  of  the  tasks  or  the  number  of  arriving  tasks.  As  the  decision 
maker’s  total  activity  became  greater  than  the  workload  bound,  functions  become  delayed. 
During  normal  operation  the  task  processing  stage  of  all  decision  makers  is  equally  delayed  at 
one  time  unit,  however  functions  causing  a  decision  maker  to  become  overloaded  incur 
additional  delay,  thus  degrading  the  organizational  performance.  The  workload  limit  was  varied 
among  three  different  values,  low,  medium  and  high,  during  different  iterations  of  the 
simulations. 

The  organization  output  was  evaluated  on  performance  measures  that  relate  organizational 
performance  to  adaptation  strategy.  For  a  given  task,  there  is  only  a  limited  period  of  time  during 
which  the  organizational  response  will  be  effective.  This  time  period  is  called  a  window  of 
opportunity.  The  timeliness  of  each  organizational  response  was  scored  based  on  the  task’s 
window  of  opportunity;  if  the  response  was  within  the  window,  it  was  given  a  score  of  one, 
otherwise  it  received  a  score  of  zero.  Based  on  the  score,  the  percentage  of  timely  tasks  can  be 
calculated  and  used  to  compare  the  performance  of  different  organizations  under  different 
adaptation  strategies. 

The  organizational  model  is  reviewed  in  Section  2.  Section  3  describes  in  more  detail  the  five 
stage  interacting  decision  maker.  Section  4  describes  how  ideas  from  information  theory  can  be 
used  to  compute  the  individual  decision  maker’s  total  activity,  which  will  be  used  to  monitor  the 
decision  maker’s  workload.  The  virtual  experiment  is  presented  in  Section  5  as  an  example  of  the 
model,  methodology,  and  effects  of  different  adaptation  strategies.  Section  6  concludes  the 
paper. 

2.  Organizational  Model 

An  organization  is  formed  in  order  to  perform  a  set  of  tasks  that  individual  decision  makers 
cannot  perform  alone.  The  tasks  to  be  performed  by  the  organization  consist  of  receiving  signals 
or  inputs  from  one  or  more  sources,  processing  them,  and  producing  outputs  which  can  be 
actions  or  signals  [Boettcher  and  Levis,  1983].  The  structure  of  the  organization  is  defined  by  the 
interactions  between  the  decision  makers.  Models  of  organizations  are  used  in  order  to  answer  a 
set  of  specific  questions  about  its  behavior.  As  the  questions  asked  about  organizations  start  to 
deal  with  change  and  adaptation,  the  models  designed  to  answer  these  questions  must  be  able  to 


exhibit  change.  Many  of  the  early  models  of  organizations  used  a  structured  analysis  approach  in 
order  to  design  the  behavioral  models.  These  models  are  based  on  a  fixed,  functional 
decomposition  of  the  tasks  in  the  system  [Levis,  1999].  The  functions  are  then  arranged  in  a 
specific  partial  order  that  when  activated  will  achieve  the  goal.  This  partial  order  represents  the 
process  that  the  system  invokes  to  respond  to  the  task.  This  model  of  the  system  is  fixed;  any 
change  made  to  the  organization  or  to  the  process  requires  a  change  in  the  structure  of  the  model, 
therefore  this  type  of  model  can  not  answer  questions  about  change. 

An  alternative  modeling  approach  used  for  organizational  modeling  is  the  object  oriented 
approach,  which  borrows  techniques  from  software  engineering.  The  object  oriented 
methodology  begins  with  the  concept  of  an  object  [Rumbaugh  et  ah,  1991].  An  object  is  an 
abstraction  of  the  real  world  that  captures  a  set  of  variables  which  correspond  to  actual  real  world 
behavior  [Sage,  1993].  These  objects  are  instantiated  by  the  model  as  they  are  needed  to 
represent  the  behavior  of  the  organization.  This  approach  can  be  used  to  create  a  model  where 
the  process  is  not  fixed,  but  is  represented  by  the  order  of  the  functions  as  they  are  invoked 
[Handley,  1999]. 

The  object  oriented  design  of  the  organization  provides  the  top  page  in  a  hierarchical,  Colored 
Petri  net  executable  model.  Petri  nets  provide  a  graphical  modeling  language  with  which  to 
represent  a  system  and  an  underlying  mathematical  theory  for  rigorous  analysis  [Murata,  1989]. 
They  can  represent  the  external  interactions  of  the  decision  makers  as  well  as  any  internal 
algorithms  the  decision  maker  must  perform.  Ordinary  Petri  nets  are  bipartite  directed  graphs 
[Peterson,  1981].  There  are  two  sets  of  nodes:  places  denoted  by  a  circle  node  and  transitions 
modeled  by  a  bar  node.  The  arcs  or  connectors  that  connect  these  nodes  are  directed  and  fixed. 
They  can  only  connect  a  place  to  a  transition  or  a  transition  to  a  place.  A  Petri  net  also  contains 
tokens.  Tokens  are  depicted  graphically  by  indistinguishable  dots  and  reside  in  places.  A 
marking  of  a  Petri  Net  is  a  mapping  that  assigns  a  non  negative  integer,  representing  the  number 
of  tokens,  to  each  place.  A  transition  is  enabled  by  a  marking,  if  and  only  if  all  of  its  input  places 
contain  at  least  one  token.  An  enabled  transition  can  fire.  When  the  firing  takes  place,  a  new 
marking  is  obtained  by  removing  a  token  from  each  input  place  and  adding  a  token  to  each 
output  place.  The  dynamical  behavior  of  the  system  is  embedded  in  the  changing  of  the 
markings. 

Colored  Petri  nets  are  an  extension  of  Petri  nets  [Jensen,  1990].  Instead  of  indistinguishable 
tokens,  tokens  now  carry  attributes  or  colors.  Tokens  of  a  specific  color  can  only  reside  in  places 
that  have  the  same  color  set  associated  with  them.  The  requirements  to  fire  a  transition  are  now 
specified  through  arc  inscriptions;  each  input  arc  inscription  specifies  the  number  and  type  of 
tokens  that  need  to  be  in  the  place  for  the  transition  to  be  enabled.  Likewise,  output  arc 
inscriptions  indicate  what  tokens  will  be  generated  in  an  output  place  when  the  transition  fires.  A 
global  declaration  node  of  the  Colored  Petri  net  contains  definitions  of  all  variables,  color  sets, 
and  domains  for  the  model. 

The  top  page  of  the  Colored  Petri  net  model  of  the  organization  is  shown  in  Fig.  1.  The  place 
with  the  color  set  Scenario  must  contain  an  initial  marking  of  the  list  of  tasks  and  their  entrance 
times  used  to  simulate  the  model.  Each  task  enters  the  model  at  its  indicated  time  through  the 
first  transition.  Each  task  is  initiated  by  a  decision  maker  who  completes  the  first  function  and 


launches  the  process  for  that  task.  When  one  decision  maker  completes  a  function  in  the  process, 
he  uses  his  internal  algorithms  to  identify  the  next  function  and  the  next  decision  maker  in  the 
process  until  the  task  is  complete. 


LIN  OutData 


color  Function  =  with  fl  |f2|f3|f4|f5|f6|f7|f8|f9|f1 0; 
var  f :  Function; 

color  DecMaker  =  with  DM0|DM1  |DM2|DM3|DM4|DM5|DML; 
var  dm  :  DecMaker; 
color  Data  =  string  timed; 
var  datjd  :  Data; 

color  XINT  =  product  Function*DecMaker*Data*Data; 
color  WLin  =  product  DecMaker*Function; 
color  FctTime  =  int  timed; 
vart :  FctTime; 

color  LIN  =  productFunction*Data*FctTime; 

color  Order  =  with  p0|p1 ; 

color  OrderOut  =  product  Function*Order; 

color  OutData  =  product  Data*FctTime*FctTime*FctTime; 

color  Super  =  with  yes|no; 

color  Bckup  =  with  loc|glob; 

color  OLFlag  =  with  ol|ul  timed; 

color  DMWL  =  product  DecMaker'OLFlag 

color  Scenario  =  product  Function*DecMaker*Data*Data*FctTlme; 


Figure  1 :  Colored  Petri  net  Model  of  the  Organization 

The  two  places  with  color  sets  Super  and  Bckup  are  given  initial  markings  to  indicate  the 
adaptation  strategy  to  be  used  by  the  organization.  The  Communication  sub  page  routes 
information  among  the  decision  makers  and  the  monitors.  The  Org  Monitor  provides  the 
organization’s  state  information  by  generating  a  score  for  each  task  when  it  is  completed.  The 
initial  decision  maker  in  a  task  uses  this  information  to  select  the  process  for  a  new  task  based  on 
the  last  similar  task’s  score,  when  the  organization  is  operating  under  global  adaptation.  The  DM 
Monitor  provides  decision  maker  status  information  by  evaluating  each  decision  maker’s 


workload  as  functions  are  initiated  and  completed.  The  decision  makers  use  this  information  to 
select  alternative  decision  makers  for  overloaded  decision  makers  when  the  organization  is 
operating  under  local  adaptation.  The  overloaded  decision  maker  information  is  also  used  to 
insert  a  processing  delay  whenever  an  overloaded  decision  maker  receives  an  additional 
function.  The  model  continues  to  process  tasks  until  the  task  list  is  exhausted  and  there  is  a  score 
for  each  task.  For  a  complete  description  of  the  organizational  model  see  Handley  [1999]. 

3.  Decision  Maker  Model 

The  main  component  of  the  organizational  model  is  the  five  stage  decision  maker  model.  March 
and  Simon  [1958]  hypothesized  that  decision  makers  follow  a  two  step  process:  first  determining 
the  situation  and  then  determining  a  response.  This  led  to  a  two  stage  decision  maker  model  by 
Wohl  [1981]  and  was  expanded  to  four  stages  by  Boettcher  and  Levis  [1982].  Remy  and  Levis 
[1988]  formalized  the  interactions  between  decision  makers  based  on  the  four  stage  model.  Levis 
[1992]  presented  a  model  of  a  five  stage  interacting  decision  maker  that  subsumed  the  previous 
models.  The  model  presupposes  that  the  decision  makers  are  executing  well-defined  tasks  for 
which  they  have  been  trained  and  that  there  is  a  limit  to  the  amount  of  processing  a  decision 
maker  can  perform  [Boettcher  and  Levis,  1982]. 

The  five  stage  decision  maker  model  of  Levis  [1992]  is  shown  in  Fig.  2.  The  decision  maker 
receives  a  signal,  x,  from  the  external  environment  or  from  another  organization  member.  The 
situation  assessment  stage  (SA)  represents  the  processing  of  the  incoming  signal  to  obtain  the 
assessed  situation,  z,  which  may  be  shared  with  other  decision  makers.  The  decision  maker  can 
also  receive  a  signal  z  %  from  another  decision  maker;  z  $  and  z  are  then  fused  together  in  the 
information  fusion  (IF)  stage  to  produce  z  %  $  .  The  fused  information  is  then  processed  at  the 
task  processing  (TP)  stage  to  produce  v.  A  command  or  control  information  from  another 
decision  makers  is  received  as  v  %  .  The  command  interpretation  (Cl)  stage  then  combines  v  and 
v  %  to  produce  the  variable  w,  which  is  input  to  the  response  selection  (RS)  stage.  The  RS  stage 
then  produces  the  output  y  to  the  environment,  or  the  output  y  %  to  other  decision  makers. 


Figure  2:  Five  Stage  Interacting  Decision  Maker  [Levis,  1992] 

Z'  V' 


The  model  depicts  the  stages  at  which  a  decision  maker  can  interact  with  other  decision  makers 
or  the  environment.  A  decision  maker  can  receive  inputs  from  the  external  environment  only  at 
the  SA  stage.  However,  this  input  x  can  also  be  from  another  decision  maker’s  y  %  from  within 
the  organization.  A  decision  maker  can  share  his  assessed  input  through  the  z  output  at  this  stage. 
The  z  |  input  to  the  IF  stage  is  used  when  the  decision  maker  is  receiving  a  second  data  input. 
This  input  must  be  generated  from  within  the  organization  and  can  be  the  output  of  another 
decision  maker’s  SA  or  RS  stage.  The  fused  information  from  the  IF  stage,  z  %  ,  it  the  input  to 
the  TP  stage.  The  decision  maker’s  function  is  performed  at  this  stage  and  results  in  the  output  v. 


In  the  Cl  stage,  the  decision  maker  can  receive  control  information  as  the  input  v  $  .  This  is  also 
internally  generated  and  must  originate  from  another  decision  maker’s  RS  stage.  In  the  RS  stage, 
an  output  is  produced;  y  is  the  output  to  the  environment  and  y  %  is  the  output  to  another 
decision  maker.  Thus  the  interactions  between  two  decision  makers  are  limited  by  the  constraints 
enumerated  above:  the  output  from  the  SA  stage,  z,  can  only  be  an  input  to  another  decision 
maker’s  IF  stage  as  z  $  ,  and  an  internal  output  from  the  RS  stage,  y  %  ,  can  only  be  input  to 
another  decision  maker’s  SA  stage  as  x,  IF  stage  as  z  %  ,  or  Cl  stage  as  v  %  . 

Subsets  of  the  five  stage  decision  maker  model,  called  roles ,  can  be  defined  depending  on  the 
requirements  of  the  function  being  performed  by  the  decision  maker.  Since  a  single  decision 
maker  may  be  assigned  to  a  variety  of  functions,  he  may  be  required  to  perform  a  variety  of  roles 
with  different  frequency  during  the  execution  of  a  process.  By  defining  the  different  types  of 
roles  that  may  be  required  for  the  different  functions  as  subsets  of  the  five  stage  model,  these 
individual  role  models  can  then  be  folded  back  into  one  decision  maker  model.  This  allows  one 
decision  maker  model  to  represent  the  different  roles  that  the  decision  maker  may  require  while 
completing  functions  during  the  course  of  a  process. 

Since  there  are  strong  constraints  in  the  allowable  interactions  between  a  decision  maker  and  the 
external  environment,  as  well  as  between  a  decision  maker  and  the  rest  of  the  organization,  as 
described  in  the  preceding  section,  one  way  to  define  the  required  roles  is  in  terms  of  the 
allowable  interactions  for  each  role.  In  other  words,  the  different  roles  a  decision  maker  needs  to 
assume  in  the  course  of  a  process  can  be  defined  by  the  inputs  he  receives  and  the  outputs  he 
produces  for  each  specified  function  he  performs.  The  model  has  three  inputs,  x,  z  %  ,  and  v  $ 
which  are  inputs  to  the  SA,  IF,  and  Cl  stage  respectively.  It  also  has  three  outputs,  z,  y,  and  y  % 
which  are  outputs  from  the  SA,  RS,  and  RS  stages  respectively.  Therefore  the  role  required  by  a 
function  can  be  specified  by  a  vector  representing  these  inputs  and  outputs  as  [x,  z  %  ,  v  %  :  z,  y, 
y  %  ].  A  one  indicates  that  input  or  output  is  required,  a  zero  indicates  that  it  is  not.  Note  that  not 
all  combinations  are  acceptable  roles;  the  acceptable  roles  for  each  function  in  the  process  must 
be  defined. 

In  the  independent  role  (I)  a  decision  maker  can  complete  the  function  without  interacting  with 
other  decision  makers.  This  role  only  requires  the  x  input  and  produces  a  y  output.  In  the  Output 
Coordinating  role  (OC)  the  decision  maker  needs  to  send  his  output  to  two  or  more  subsequent 
decision  makers.  This  role  requires  the  input  data  x  and  both  outputs  y  and  y  $  .  In  the  Input 
Coordinating  role  (IC)  the  decision  maker  needs  to  receive  inputs  from  two  or  more  prior 
decision  makers  to  complete  his  function.  A  decision  maker  in  this  role  requires  the  input  x  and 
the  information  fusion  input,  z  $  and  produces  the  output  y.  Each  of  these  roles  is  defined  as  a 
unsupervised  mode,  since  none  of  them  receive  a  v  %  input.  If  the  process  is  being  completed 
autonomously  by  the  decision  makers,  then  these  are  the  roles  that  are  necessary.  However,  by 
adding  the  v  $  input  to  each  role,  the  roles  are  now  supervised.  The  supervised  mode  is 
necessary  to  insert  control  information  into  the  decision  maker  model  when  adaptation  is  present. 
Table  1  summarizes  the  three  roles  with  their  characteristic  vectors.  Note  that  the  x  in  the  v  $ 
column  represents  that  the  role  can  be  unsupervised  if  the  value  of  x  is  zero  and  supervised  if  the 
value  of  x  is  one. 


Table  1:  Roles  and  Characteristic  Vectors 


ROLE 

(X,  Z  %  ,  v  g  :  z,  y, 

Independent  (1) 

(1, 0,  x  :  0,  1, 0) 

Output  Coordinating  (OC) 

(1, 0,  x  :  0,  1,  1) 

Input  Coordinating  (1C) 

(1,  1,  x  :  0,  1,0) 

4.  Decision  Maker  Workload 

One  of  the  main  causes  of  error  in  an  organization’s  output,  and  therefore  a  main  driver  of 
organizational  change,  is  overloaded  decision  makers.  Decision  makers  can  only  handle  a  finite 
amount  of  activity  in  a  given  time  period.  If  this  amount  of  activity  increases  or  the  amount  of 
time  available  to  do  the  required  activity  decreases,  the  decision  maker  reaches  a  point  where  he 
can  no  longer  accomplish  his  functions  in  the  given  time.  This,  in  turn,  manifests  itself  in  the 
form  of  delayed  output  and/or  incomplete  or  incorrect  output.  At  an  individual  level,  this  may  be 
sensed  immediately  by  the  subsequent  decision  maker  in  the  task  process.  At  the  organizational 
level,  the  delay  and/or  error  propagates  through  the  process  and  effects  the  organizational  output. 
When  the  organizational  output  no  longer  meets  the  requirements,  it  is  a  signal  that  the  current 
process  is  no  longer  appropriate  and  an  organizational  change  should  be  made. 

4.1  Total  Activity  as  a  Workload  Surrogate 

An  organization  completes  a  task  by  using  a  specified  process  to  produce  the  appropriate  output 
in  response  to  the  task  input;  the  process  consists  of  a  series  of  functions  assigned  to  individual 
decision  makers.  Within  this  organizational  context  each  decision  maker  acts  as  an  information 
processing  system.  He  receives  signals  or  messages  that  contain  information  relevant  to  the 
functions  he  has  to  perform  in  the  processing  of  the  organizational  task.  He  performs  his 
requested  function  by  interpreting  his  input  information  and  produces  output  information. 
Therefore,  it  is  postulated  that,  an  information  theoretic  model  of  the  decision  maker  can  be  used 
as  a  means  to  monitor  the  workload  incurred  by  a  decision  maker  as  he  performs  different 
functions  within  the  organizational  task  process  [Boettcher  and  Levis,  1982]. 

A  primary  quantity  of  interest  in  information  theory  is  entropy:  given  a  variable  x,  which  is  an 
element  of  the  alphabet  X,  and  occurs  with  probability  p(x),  the  entropy  of  x,  H(x),  is  defined  to 
be 

H(x)  =  -^p(x)logp(x)- 

x 

Entropy  is  measured  in  bits  per  symbol  when  the  base  of  the  logarithm  is  two,  as  this  is  the 
number  of  binary  digits  needed  to  represent  the  value.  Entropy  represents  the  uncertainty 
associated  with  the  variable:  if  one  value  is  much  more  likely  than  the  others,  the  entropy  value 
will  be  low,  however,  if  all  values  are  equally  likely,  the  entropy  value  will  be  at  a  maximum. 
The  entropy,  H(x),  is  associated  with  each  occurrence  of  x.  As  long  as  the  probability 
distribution  of  x  remains  the  same,  each  occurrence  of  x  has  the  same  entropy  value.  Total 
activity  of  a  system,  G,  can  be  defined  as  the  sum  of  the  entropy  of  all  the  variables,  Wj,  in  the 
system: 


G  =  Lj  H(Wi). 


The  total  activity  of  the  decision  maker,  G,  has  been  used  as  a  surrogate  measure  for  the 
workload  of  the  decision  maker  performing  a  function,  which  can  not  be  measured  directly 
[Levis,  1992].  Several  steps  are  used  to  compute  the  total  activity  for  each  decision  maker 
performing  a  function.  First  the  algorithms  present  in  each  stage  of  the  five  stage  model  are 
defined  in  order  to  identify  all  the  variables  in  the  model.  For  each  function,  the  algorithms 
active  in  each  stage  of  the  model  must  be  identified  and  probabilities  associated  with  the 
variables.  The  algorithms  are  also  dependent  on  which  adaptation  strategy  is  being  implemented. 
Then  the  total  activity  for  a  decision  maker  completing  that  function  under  a  specified  adaptation 
strategy  can  be  calculated  by  summing  the  entropy  of  each  stage;  the  total  activity  of  the  decision 
maker  is  equal  to  the  sum  of  the  total  activities  of  each  stage: 

N 

G  =  EGi 

i=l 

where  N  is  the  number  of  stages  [Conant,  1976]. 


Figure  3:  The  Next  Function  Algorithm  of  the  Response  Selection  Stage 

The  total  activity  due  to  the  adaptation  strategy  is  represented  by  the  algorithms  in  the  response 
selection  and  post  stages.  In  the  response  selection  stage  the  next  function  for  a  given  process  is 
found.  When  an  organization  is  utilizing  a  global  adaptation  strategy,  the  algorithm  must  include 
all  the  alternative  processes,  as  shown  in  Fig  3.  If  the  organization  is  using  none  or  local  backup, 
this  algorithm  potentially  contains  fewer  variables  as  it  only  maintains  one  process;  thus  the 
entropy  calculation  for  this  stage  includes  the  overhead  for  the  global  adaptation  strategy.  When 
an  organization  implements  the  global  adaptation  strategy,  the  decision  makers’  response 
selection  stage  includes  additional  entropy  due  to  maintaining  information  on  all  possible 
processes. 


If  the  adaptation  strategy  is  none  or  global,  a  secondary  decision  maker  is  not  chosen,  regardless 
of  the  status  of  the  primary  decision  maker.  In  this  case  the  output  produced  at  the  end  of  the 
response  selection  stage  is  the  final  output.  However,  if  the  strategy  is  local  adaptation,  a 
secondary  decision  maker  is  chosen  in  the  post  stage  if  the  primary  decision  maker  is 
overloaded;  this  algorithm  is  shown  in  Fig.  4.  The  entropy  calculation  for  this  stage  includes  the 
overhead  for  the  local  adaptation  strategy.  When  an  organization  implements  the  local  adaptation 
strategy,  the  decision  makers’  post  stage  includes  additional  entropy  due  to  maintaining 
information  on  backup  decision  makers. 


Figure  4:  The  Backup  Decision  Maker  Algorithm  of  the  Post  Stage 

Total  activity  based  on  the  internal  algorithms  of  the  decision  maker  model  has  been  previously 
used  as  the  workload  surrogate  for  a  decision  maker  performing  a  single,  repetitive  function 
[Louvet  et  al.,  1988;  Andreadakis,  1988;  and  Jin  and  Levis,  1992].  However,  in  an  organization, 
a  decision  maker  is  often  assigned  to  more  than  one  type  of  function.  He  may  be  assigned  a 
function  early  in  the  process  and  then  another  function  later  on.  The  set  of  functions  an 
organization  must  perform  within  a  process  can  be  represented  by  a  vector  x  which  takes  values 
from  an  alphabet  X,  the  set  of  organizational  functions.  Each  component  of  the  vector  represents 
one  of  the  functions,  i.e. 

^  —  (f ! , f 2 ,•  •  *f N )  xeX. 

This  vector  can  then  be  partitioned  into  groups  of  functions  that  are  assigned  to  different  decision 
makers  through  partitioning  matrices.  The  partitioning  matrix  for  the  ith  decision  maker  is 
denoted  n1,  and  results  in  the  partition  x1: 


x'  =n'x. 


The  set  of  partitioning  matrices  {II1,  Id2,...  n1}  has  been  used  to  specify  the  inputs  received  by 
each  decision  maker  from  the  organizational  environment  by  Stabile  and  Levis  [1984]  and  is 
now  modified  to  represent  the  partition  of  the  functions  of  a  process  to  the  individual  decision 
makers.  The  resulting  vectors,  x1,  may  have  some,  all,  or  no  components  in  common.  If  there  are 
duplicate  components,  this  indicates  that  more  than  one  decision  maker  is  qualified  to  complete 
that  function.  This  redundancy  can  be  used  later  to  determine  the  primary  and  secondary  decision 
maker  for  the  function  necessary  for  the  local  adaptation  strategy.  Each  decision  maker  is 
assigned  a  set  of  specific  functions  to  perform  based  on  the  x1  partitions.  The  number  and  type  of 
functions  performed  by  the  organization  are  determined  by  the  process  definition.  The  number  of 
occurrences  of  each  function  within  the  set  of  processes  the  organization  is  performing  can  be 
used  to  assign  probabilities  to  the  input  vector  of  each  decision  maker. 

When  a  decision  maker  receives  a  function,  he  first  determines  which  function  it  is.  Because  no 
learning  takes  place  during  the  performance  of  a  sequence  of  functions,  the  successive  values 
taken  by  the  variables  of  the  model  are  uncorrelated,  i.e.,  the  model  is  memoryless  [Boettcher 
and  Levis,  1982].  The  value  of  an  arriving  input  is  not  known  to  the  decision  maker;  rather,  it  is 
known  only  that  an  input  is  present.  When  a  decision  maker  is  assigned  to  more  than  one  type  of 
function,  his  task  processing  stage  must  include  the  alternative  algorithms.  Intuitively,  a  decision 
maker  is  assigned  to  functions  based  on  his  skills;  these  skills  are  represented  as  the  set  of 
function  algorithms  in  his  task  processing  stage. 

Table  2:  Methodology  to  Compute  Decision  Maker  Total  Activity 


Step  1 :  Define  Task  Processing  Algorithm  for  Each  Function. _ 

Step  2:  Compute  Total  Activity  for  Each  Function: 

-Include  additional  entropy  due  to  role, 

_ -Consider  inputs  to  function  independent  for  input  entropy  calculation. 

Step  3:  Determine  Each  Decision  Maker’s  Function  Input  Vector  x1: 

-Enumerate  each  Decision  Maker’s  Function  based  on  the  Process(es)  and 

_ -Consider  each  Adaptation  Strategy. _ 

Step  4:  Compute  Each  Decision  Maker’s  Total  Activity: 

-Determine  the  Frequency  of  Each  Function  in  the  Set  of  Processes, 

_ -Add  an  Additional  Decision  Variable  for  each  Additional  Function. _ 

Step  5:  Compute  the  Additional  Entropy  due  to  Adaptation  Strategy. _ 

Step  6:  Compute  Each  Decision  Maker’s  Final  Total  Activity. _ 


The  final  total  activity  for  a  decision  maker  performing  a  function  is  determined  based  on  his  set 
of  assigned  functions  x1  and  the  adaptation  strategy.  Table  2  summarizes  the  steps  to  calculate 
each  decision  maker’s  total  activity.  The  first  step  is  to  define  the  task  processing  algorithm  for 
each  function.  The  second  step  calculates  the  total  activity  for  each  function  by  calculating  the 
entropy  of  the  each  stage’s  algorithm  required  by  the  role  and  summing  the  entropy  of  the  stages. 
The  inputs  to  the  functions  are  considered  independent  for  this  calculation,  unless  there  is  reason 
not  to.  At  the  end  of  this  step,  there  is  a  total  activity  value  for  each  function. 

Step  three  considers  the  set  of  functions  being  performed  by  each  decision  maker.  This  set 
changes,  based  on  what  process(es)  are  being  considered  and  what  adaptation  strategy  is  being 
implemented.  For  example,  different  processes  contain  different  sets  of  functions.  The  set  of 
functions  should  include  only  the  functions  required  by  the  processes  being  considered  for  that 


organizational  configuration.  Likewise  local  adaptation  requires  backup  functions  which  may  not 
be  included  in  global  adaptation.  In  step  four,  the  frequency  of  each  function  within  each 
decision  maker’s  set  of  functions  can  be  used  to  calculate  the  input  entropy  associated  with  the 
choice  of  task  processing  algorithm  to  use  in  the  decision  maker’s  task  processing  stage; 
likewise,  for  each  function  beyond  one,  additional  entropy  must  be  included  to  determine  which 
task  processing  algorithm  to  use. 

Step  five  computes  the  additional  entropy  due  to  the  existence  of  the  adaptation  strategy.  The 
next  function  algorithm  in  the  response  selection  stage  and  the  backup  decision  maker  algorithm 
in  the  post  stage  both  depend  on  the  adaptation  strategy.  The  entropy  associated  with  both  of 
these  algorithms  must  be  calculated  under  the  different  strategies.  Finally  each  decision  maker’s 
total  activity  can  be  calculated  by  using  the  total  activity  value  from  step  four  and  adding  the 
appropriate  additional  entropy  based  on  the  adaptation  strategy  from  step  five.  This  total  activity 
value  can  now  be  used  as  an  estimate  of  the  workload  a  decision  maker  experiences  each  time  he 
is  asked  to  perform  one  of  his  assigned  functions. 

Now,  assume  the  decision  maker  is  asked  to  do  two  functions  from  his  set  of  functions.  His  total 
activity  increases.  If  he  consistently  uses  the  same  algorithmic  structure,  that  is  his  internal 
variables  are  the  same,  the  total  activity  for  two  functions,  G2,  is  [Louvet  el  al.,  1988]: 

k  2k+l 

G2  =H(x/)  +  £H(w1)+  £H(wi)  +  H(y/) 

i=l  i-k+1 

where  x  %  and  y  %  represent  the  dual  input  and  dual  output  respectively.  If  the  probability 
distributions  for  the  input  and  output  variables  composing  the  input  and  output  pair  are  the  same 
as  in  the  single  task  case  then 

k 

G2  =2H(x)  +  2j^H(Wj)  +  2H(y)<  2G, 

i=l 

where  Gi  is  the  total  activity  of  the  single  task  case.  This  indicates  that  the  total  activity  value 
calculated  for  a  decision  maker  performing  a  single  function  from  his  set  of  functions  can  be 
doubled  and  used  to  represent  the  total  activity  he  experiences  when  he  performs  two  functions 
from  his  set  of  functions.  This  property  is  the  independence  bound  on  entropy  which  states  that 

H(X1,X2,...,Xn)<£H(Xi) 

i=l 

with  equality  if  and  only  if  the  Xj  are  independent  [Cover  and  Thomas,  1991].  This  can  be  used 
to  monitor  the  workload  of  the  decision  maker:  each  time  the  decision  maker  receives  a  function 
to  perform,  his  current  workload  is  increased  by  his  total  activity  value.  Each  time  he  completes 
a  function,  his  workload  is  decreased  by  this  amount.  Thus  the  current  workload  of  the  decision 
maker  depends  on  the  number  of  functions  he  performs  simultaneously.  As  long  as  the 
probability  distribution  of  the  input  variable  remains  constant,  the  total  activity  of  the  aggregate 
functions  a  decision  maker  is  responsible  for  can  be  used  as  a  workload  monitor  for  the  decision 
maker. 

4.2  The  Effect  of  Adaptation  Strategy  on  Total  Activity 

The  majority  of  the  total  activity  value  comes  from  three  stages,  the  task  processing  stage,  which 
holds  the  algorithms  for  all  the  functions  the  decision  maker  is  responsible  for,  and  the  response 


selection  and  post  stages,  where  the  next  function  and  next  decision  maker  in  the  process  are 
chosen.  This  dependency  can  be  shown  as 

G TOT  ^  (C*TP’^RS’^p) 

where  GTOt  is  the  total  activity  of  the  decision  maker,  GTP  is  the  total  activity  of  the  task 
processing  stage,  Grs  is  the  total  activity  of  the  response  selection  stage,  and  Gp  is  the  total 
activity  of  the  post  stage.  Gtp  is  dependent  on  the  number  of  functions  a  decision  maker  is 
responsible  for,  nf,  assuming  they  have  a  comparable  number  of  internal  decision  variables: 

Gtp  =  f  (nf ) . 

Grs  and  Gp  are  dependent  on  the  adaptation  strategy.  First  consider  the  case  of  no  adaptation 
strategy.  Grs  contains  the  algorithm  to  select  the  next  function  for  a  single  process  PO;  the  total 
activity  associated  with  this  algorithm  depends  on  the  internal  variables  of  the  PO  decision  tree, 

Wpo: 

GrS-NONE  =  f(WP())  • 

Since  no  backup  decision  maker  information  is  necessary  for  this  adaptation  strategy,  the  total 
activity  of  the  post  stage  is  zero: 

^  P-NONE  ~  0  ■ 

Therefore  the  total  activity  for  a  decision  maker  under  the  none  adaptation  strategy  can  be 
represented  as 

^TOT-NONE  =  f  (nf  5  WP0>0)  . 

The  local  adaptation  strategy  increases  the  total  entropy  of  the  decision  maker  in  two  ways.  First, 
it  may  increase  the  number  of  functions  a  decision  maker  is  responsible  for  by  adding  additional 
functions  due  to  backup  responsibilities,  nBupf,  which  increases  Gtp: 

G  TP-LOCAL  =  f  (nf  +  nBupf  )  • 

These  are  backup  functions  that  the  decision  maker  is  responsible  for  that  were  not  previously 
included  in  his  partition.  Secondly,  it  adds  the  backup  decision  maker  algorithm  wbup  to  the  post 
stage,  increasing  GP: 

Gp-LOCAL  ~  f  (  W  Bup  )  • 

The  activity  of  the  response  selection  stage  is  unchanged,  as  local  adaptation  only  supports  one 
process.  Therefore  the  total  activity  for  a  decision  maker  under  the  local  adaptation  strategy  can 
be  represented  as 

^ TOT-LOCAL  =  f  (nf  +  nBupf  ’  WP0’WBup)  • 

The  global  adaptation  strategy  also  increases  the  total  entropy  in  two  ways.  First,  it  also  may 
increase  the  number  of  functions  a  decision  maker  is  responsible  for  by  adding  additional 
functions,  nPif,  which  increases  Gtp: 

G  tp-global  =  f  (nf  +  npif )  • 

These  are  additional  functions  due  to  the  second  process  that  the  decision  maker  is  now 
responsible  for  that  were  not  previously  included  in  his  partition.  Secondly,  it  adds  a  second  next 
function  algorithm  to  the  response  selection  stage,  wPi,  representing  the  alternative  process, 
increasing  Grs: 


G  RS-GLOBAL  —  ^  (  W  PO  +  W  PI  )  • 


Similar  to  the  none  adaptation  strategy,  global  adaptation  does  not  support  decision  maker 
backup,  therefore  the  activity  of  the  post  stage  remains  at  zero.  Therefore  the  total  activity  for  a 
decision  maker  under  the  global  adaptation  strategy  can  be  represented  as 

G TOTAL -GLOBAL  =  f  (nf  +  nPlf  ’  W  PO  +  W  PI  »0)  . 

Both  adaptation  strategies  increase  the  decision  maker’s  total  activity  value  greater  than  the  none 
strategy.  They  both  may  increase  the  number  of  functions  a  decision  maker  is  responsible  for 
which  increases  the  total  activity  of  the  task  processing  stage.  The  principal  difference  is  in  the 
response  selection  and  post  stages:  local  adaptation  adds  an  additional  algorithm  to  the  post 
stage,  while  global  adaptation  adds  an  additional  algorithm  to  the  response  selection  stage.  Local 
and  global  adaptation  are  orthogonal;  which  strategy  has  a  greater  effect  depends  on  the  specific 
organization  and  its  task  graphs.  It  cannot  be  determined  by  inspection,  an  executable  model  is 
necessary  to  determine  the  more  effective  strategy. 

4.3  Monitoring  Decision  Maker  Workload  and  Organizational  Performance 

The  total  activity  value  for  each  decision  maker  represents  the  workload  he  incurs  each  time  he 
receives  any  one  of  the  functions  from  his  partition;  one  total  activity  value  is  associated  with 
each  decision  maker  for  each  organizational  design,  i.e.  function  allocation  and  adaptation 
strategy.  If  the  adaptation  strategy  is  changed  or  the  function  partition  is  changed,  the  total 
activity  value  must  be  recalculated.  The  independence  bound  property  of  entropy  was  used  to 
show  that  if  the  decision  maker  receives  two  functions  at  once,  from  his  partition  of  functions, 
his  total  activity  value  doubles.  This  can  be  generalized  to  multiple  occurrences  of  simultaneous 
functions:  each  time  the  decision  maker  receives  a  function,  his  current  workload  is  increased  by 
the  total  activity  value  and  each  time  he  completes  a  function  his  total  workload  is  decreased  by 
the  total  activity  value.  The  current  total  activity  of  the  decision  maker,  Gcur  can  be  expressed  as 

Gc„«=LG=G*n. 

1 

This  is  possible  because  the  single  total  activity  value  for  each  decision  maker  includes  the 
uncertainty  associated  with  the  set  of  functions  partitioned  to  the  decision  maker.  This  assumes 
that  there  is  no  interactions  between  functions,  that  is  they  are  independent;  the  decision  maker 
has  no  knowledge  of  what  his  next  function  will  be. 

However,  in  order  to  use  total  activity  as  a  decision  maker  monitor,  it  is  necessary  to  determine 
the  decision  maker’s  workload  limit.  Perdu  and  Levis  [1998]  set  a  limit  on  the  number  of  tasks  a 
decision  maker  could  simultaneously  process;  each  decision  maker  and  task  were  treated 
identically.  However,  in  this  case,  each  decision  maker’s  total  activity  is  different  based  on  his 
functional  mapping;  it  can  be  assumed  that  a  decision  maker  with  a  lower  total  activity  can 
assume  more  tasks  than  a  decision  maker  with  a  higher  total  activity.  By  using  total  activity  as  a 
means  to  monitor  the  workload  status  of  a  decision  maker  during  the  course  of  repeated 
processes,  concepts  similar  to  the  bounded  rationality  constraint  can  be  used  to  establish  a 
workload  limit. 

In  studies  of  the  cognitive  demands  of  command  and  control  on  decision  making  organizations, 
it  was  found  that  a  performance  decrease  occurs  when  the  task  demands  exceed  some  limit 
[Levis,  1993].  The  mathematical  model  that  is  used  to  represent  this  phenomenon  is  that  of  the 
bounded  rationality  constraint,  which  states  that  if  the  workload  rate  exceeds  some  value,  rapid 


degradation  of  performance  occurs.  Decision  makers  normally  operate  at  a  level  where  the 
bounded  rationality  constraint  is  not  in  effect.  The  bounded  rationality  constraint  can  not  be 
determined  analytically  but  can  be  established  experimentally.  Consider  the  situation  in  which  a 
decision  maker  is  performing  a  sequence  of  functions  with  interarrival  time  x.  The  workload 
experienced  by  the  decision  maker  can  be  expressed  as: 

G  =  Ft ;  t  <  x 

where  G  is  the  decision  maker’s  workload  or  total  activity  as  previously  calculated  (bits  per 
symbol),  F  is  the  decision  maker’s  processing  rate  (bits  per  symbol  time),  and  t  is  the  portion  of 
the  inter-arrival  time  during  which  the  decision  maker  is  processing  the  function.  If  x  is  more 
than  ample,  various  tradeoffs  between  F  and  t  are  possible,  as  G  for  the  function  is  fixed. 
However,  for  sufficiently  small  values  of  x,  t  will  approach  x,  and  the  decision  maker  must 
increase  F  in  order  to  maintain  G  and  thereby  avoid  degradation  of  performance.  When  further 
increases  in  F  are  not  possible,  at  the  interarrival  time  t  §  ,  the  decision  maker  has  reached  the 
bounded  rationality  constraint,  Fmax  [Levis,  1993]. 

Since  the  bounded  rationality  constraint  can  not  be  determined  analytically,  an  adjustable 
workload  limit  is  used  in  the  model.  The  workload  limit  places  an  upper  bound  on  the  amount  of 
tasks  a  decision  maker  can  accept  in  one  processing  interval.  If  the  decision  maker  receives  a  set 
of  inputs  that  exceeds  the  workload  limit,  the  decision  maker’s  status  changes  to  “overloaded”.  If 
new  functions  are  sent  to  the  decision  maker  while  he  is  in  the  overloaded  status,  they  are 
delayed  one  processing  unit,  representing  the  degradation  in  performance  associated  with 
overloaded  decision  makers.  When  the  decision  maker’s  status  returns  to  “underloaded”, 
functions  are  once  again  completed  in  a  single  processing  unit.  The  local  or  decision  maker 
monitor  provides  the  mechanism  to  monitor  the  workload  of  the  individual  decision  makers.  The 
output  of  the  monitor,  the  decision  makers’  workload  status,  is  used  in  the  post  stage  of  the 
decision  maker  model  to  determine  if  a  backup  decision  maker  is  necessary  when  the 
organization  is  operating  under  local  adaptation,  and  to  indicate  when  functions  should  be 
delayed  due  to  overloaded  decision  makers. 

Timeliness  expresses  the  organization’s  ability  to  respond  to  an  incoming  task  within  an  allotted 
time.  The  allotted  time  is  the  time  interval  over  which  the  output  produced  by  the  organization  is 
effective  in  its  environment.  This  allotted  time  can  be  described  as  a  window  of  opportunity 
whose  parameters  are  determined  a  priori  by  the  requirements  of  the  task.  Different  task  types 
may  have  different  windows  of  opportunity.  Two  quantities  are  needed  to  specify  the  window  of 
opportunity:  the  lower  and  the  upper  bounds  of  the  time  interval,  ts  and  tf,  respectively,  or  one  of 
the  bounds  and  the  length  of  the  interval,  e.g.  ts  and  A  t  [Cothier  and  Levis,  1986].  In  the 
situation  where  repetitive  tasks  will  be  processed,  where  the  start  time  of  each  task  will  be 
dependent  on  the  scenario  driving  the  model,  the  window  of  opportunity  for  each  task  type  is 
defined  a  priori  with  the  second  method  with  ts  set  to  zero.  The  organization’s  response  time  is 
represented  by  the  first  method:  the  lower  bound  is  the  initial  time  of  the  task  as  received  by  the 
organization  and  the  upper  bound  is  the  finish  time  of  the  task.  The  organization’s  response  time 
is  the  time  delay  between  the  moment  when  the  organization  receives  a  task  and  the  moment  it 
produces  an  output. 

In  order  to  evaluate  if  the  organization’s  output  is  timely,  the  organization’s  response  time  is 
compared  to  the  window  of  opportunity  of  the  task.  The  initial  time  of  the  task,  ts.  is  sent  to  the 


organization  monitor  function.  When  the  last  function  of  the  process  is  complete  and  the  final 
output  is  made,  the  final  time  of  the  task  tf  is  also  sent  to  the  organizational  monitor.  The 
comparison  of  the  difference  between  these  two  times  is  compared  to  the  window  of  opportunity 
by  the  function  d((0,At),(ts,  tf))  which  represents  the  timeliness  of  the  output.  A  binary  measure 
can  be  assigned  to  each  task  to  represent  the  organization’s  score,  s,  for  this  task  based  on 
timeliness.  If  the  response  time  is  less  than  or  equal  to  the  window  of  opportunity,  the 
organization  receives  a  score  of  one,  indicating  a  timely  response.  If  the  output  is  outside  this 
window,  indicating  the  response  took  too  long,  the  organization  receives  a  score  of  zero. 

s  =  d((0,At),(ts,tf ))  = 

The  score  can  be  used  as  both  a  performance  measure  for  the  organizational  output  and  as  a 
trigger  of  adaptation  for  process  selection.  For  example,  if  a  task  receives  a  score  of  zero,  it  is  a 
signal  that  the  current  process  is  not  performing  adequately.  The  organization  should  switch 
processes  for  that  task  type  in  order  to  correct  the  untimely  response.  The  organizational  monitor 
provides  task  feedback  to  use  to  determine  the  process  for  each  task  type  when  the  organization 
is  in  a  global  adaptation  mode,  and  provides  the  score  for  each  task  processed  based  on  the 
timeliness  of  the  organization’s  response,  regardless  of  the  mode.  It  receives  the  first  and  last 
time  stamps  of  the  process;  the  start  time  is  when  the  task  is  received  by  the  system  and  the 
finish  time  is  when  the  last  function  is  completed.  It  subtracts  these  two  times  and  compares  the 
difference  to  the  task  window  of  opportunity.  It  must  then  assign  a  score  to  the  task,  and  if  the 
organization  is  implementing  a  global  adaptation  strategy,  indicate  a  process  switch,  if  necessary. 

5.  Virtual  Experiment 

A  virtual  experiment  was  conducted  by  configuring  the  organizational  model  to  actual 
experimental  organizations  and  evaluating  the  effectiveness  of  the  alternative  strategies.  In  order 
to  configure  the  model,  three  inputs  are  required:  the  task  graph,  the  organizational  design,  and 
the  experimental  design.  The  task  graphs  and  the  organizational  designs  were  obtained  from  a 
recent  subject  experiment  studying  organizational  adaptation,  while  the  experimental  design  was 
created  specifically  to  evaluate  the  different  adaptation  strategies.  The  organizational  model  was 
configured  into  two  different  organizational  designs  and  executed  under  the  three  different 
adaptation  mechanisms:  no  adaptation  allowed,  local  adaptation  using  alternative  decision 
makers,  and  global  adaptation  using  alternative  process  selection.  The  resulting  performance  of 
the  different  organizations  under  different  adaptation  strategies  was  then  compared. 

5.1  Experimental  Design 

The  Adaptive  Architectures  for  Command  and  Control  (A2C2)  is  a  research  initiative  to 
investigate  the  process  of  adaptation  in  Joint  Command  and  Control  architectures  at  the 
Commander  Joint  Task  Force  Level.  Organizations  are  designed  to  carry  out  a  predefined 
mission  under  different  stress  levels:  when  full  resources  are  available  to  complete  the  mission 
the  organization  experiences  low  stress;  when  the  number  of  resources  is  reduced,  the 
organization  experiences  higher  stress  as  it  strives  to  complete  the  same  mission  with  less 
resources.  The  organizations  that  are  designed  are  modeled  and  executed  in  a  virtual 
environment:  scenarios  are  created  that  represent  the  mission  and  threats  that  the  organization 
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will  experience.  The  organizations  are  then  used  in  subject  experiments  where  humans  respond 
to  a  simulated  environment  through  a  computer  simulation. 


The  organizations  designed  for  the  A2C2  second  experiment  had  a  sequence  of  tasks  to  perform 
based  on  an  overall  mission:  to  secure  the  port  and  airfield  of  a  friendly  nation  invaded  by  a 
hostile  neighbor.  The  sequence  of  tasks  was  represented  by  a  task  graph  that  included  beach 
landing,  clearing  roads,  and  coordinating  the  storming  of  the  port  and  airfield.  It  also  included 
defensive  tasks,  i.e.,  responding  to  threats  launched  by  the  enemy.  Each  of  these  defensive  tasks 
can  be  represented  by  its  own  task  graph:  the  series  of  functions  that  must  be  performed  in  order 
to  respond  to  the  threat.  Two  specific  threat  tasks  that  occurred  during  the  “clearing  roads” 
portion  of  the  mission  were  identified  for  the  virtual  experiment:  Frog  launchers  (FROG)  and 
Silkworm  missiles  (SIFK).  Both  of  these  threats  had  a  window  of  opportunity  for  the 
organization’s  response:  if  the  response  was  made  within  a  certain  time  period  the  enemy  would 
withdraw  the  threat  and  retreat  back  into  their  bunkers.  Both  a  nominal  and  alternative  process 
was  defined  for  both  tasks,  resulting  in  a  total  of  nine  different  functions  as  shown  in  Table  3. 

Table  3:  Organizational  Functions  and  Characteristics 


Function 

Description 

Role  Required 

Function  Type 

fl 

Threat  Notification 

Independent 

Non  Choice 

f2 

Choose  Platform 

Independent 

Choice 

f3 

Contact  Launch 

Independent 

Non  Choice 

f4 

Launch  Platform 

Independent 

Non  Choice 

f5 

Confirm  Launch 

Independent 

Non  Choice 

f6 

Coordinate  Attack 

Output  Coordinating 

Non  Choice 

f7 

Choose  Verification 

Independent 

Choice 

f8 

Threat  Confirmation 

Independent 

Non  Choice 

f9 

Confirm  Coord  Launch 

Input  Coordinating 

Non  Choice 

Two  distinct  organizational  structures,  termed  “Traditional”  and  “Non  Traditional”  were 
designed  for  the  subject  experiment;  each  had  six  decision  makers.  In  the  A2C2  program, 
decision  makers  are  defined  by  the  resources  they  are  assigned  rather  than  the  skills  they  possess; 
however,  the  decision  maker  can  be  assumed  to  have  the  skills  necessary  to  operate  the 
resources.  The  Traditional  organization  allocated  resources  to  decision  makers  in  a  geographic 
manner,  while  the  Non  Traditional  organization  allocated  resources  in  order  to  balance  the 
decision  maker  workload.  The  total  activity  value  to  use  for  each  decision  maker,  under  two 
different  process  and  the  three  different  adaptation  strategies,  was  calculated  for  the  two  different 
organizational  designs  as  shown  in  Table  4.  Note  that  the  number  of  decision  makers  is  the  same 
in  both  architectures  and  the  functions  to  be  performed  are  identical,  however  the  distribution  of 
functions  to  decision  makers  is  different. 


Table  4:  Decision  Maker  Total  Activity  (bits  per  symbol) 


Organization 

Traditional 

Non  Traditional 

Adaptation 

None 

Local 

Global 

None 

Local 

Global 

DM0 

20.6 

28.4 

35.1 

34.7 

43.7 

49.2 

DM1 

50.0 

57.8 

71.7 

42.1 

51.1 

56.6 

DM2 

29.8 

37.6 

44.3 

28.0 

37.0 

42.5 

DM3 

50.0 

57.8 

71.7 

37.8 

47.6 

52.3 

DM4 

28.6 

40.8 

63.9 

34.2 

43.2 

48.7 

DM5 

32.9 

40.8 

63.9 

34.2 

43.2 

48.7 

In  order  to  stimulate  the  organizational  models  under  different  conditions,  scenarios  of  input 
tasks  were  generated  to  provide  a  series  of  threat  inputs  to  the  organization.  The  organization 
was  stimulated  with  two  sets  of  scenarios:  one  set  varies  the  interarrival  time  of  the  tasks,  it 
consist  of  three  series  of  32  tasks,  the  second  set  varies  the  number  of  tasks  arriving  at  one  time 
interval,  it  consists  of  three  series  of  32,  40,  and  48  tasks.  The  nominal  process  was  selected  for 
the  initial  configuration.  An  organization  adapting  through  local  change  will  maintain  this 
process,  and  will  select  secondary  decision  makers  for  overloaded  decision  makers.  An 
organization  using  strategic  adaptation  will  continue  to  use  the  primary  decision  makers  but  will 
be  allowed  to  implement  alternative  processes  at  the  start  of  a  new  task.  In  order  to  cause  the 
organization  to  change,  it  must  be  stressed;  it  can  be  stressed  in  two  ways:  increasing  the 
frequency  of  arriving  tasks  or  increasing  the  number  of  tasks  arriving  per  time.  In  the  case  of 
local  change,  adaptation  should  occur  as  individual  decision  makers  become  overloaded.  In  the 
case  of  global  change,  adaptation  should  not  occur  until  the  organizational  output  deteriorates. 
The  level  of  tolerance  of  the  organization  can  be  varied  through  the  value  of  the  workload  limit. 
An  organization  with  a  low  level  of  tolerance  will  change  at  a  minimal  level  of  stress  while  an 
organization  with  a  high  level  of  tolerance  will  not  change  until  a  high  level  of  stress  is  reached. 


The  independent  variables  of  the  experiment  are  those  controlled  by  the  experimental  setup:  the 
organizational  configuration,  the  adaptation  strategy,  and  the  level  of  stress  tolerated  by  the 
decision  makers  varied  through  the  value  of  the  workload  limit.  The  dependent  variable,  or  the 
variable  to  be  observed  and  measured,  is  the  score  of  each  task  based  on  the  timeliness  of  the 
organizational  response.  For  each  scenario  of  tasks  used  to  simulate  the  organization  under  a 
specific  strategy,  the  percentage  of  tasks  with  a  score  of  one,  or  the  timeliness  percentage  S,  can 
be  calculated: 

^  Scenario  =  11  s=l  ^  11 

where  n  is  the  number  of  tasks  in  the  scenario  and  ns=i  is  the  number  of  tasks  that  received  a 
score  of  one.  This  represents  the  percentage  of  tasks  that  the  organization  completed  in  a  timely 
manner.  The  experimental  sample  space  is  shown  in  Table  5. 


Table  5:  Experimental  Sample  Space 


Organization 

Traditional 

Non  Traditional 

Adaptation 

None 

Local 

Global 

None 

Local 

Global 

Tolerance 

L  |  M  |  H 

L  |  M  |  H 

L  |  M  |  H 

L  |  M  |  H 

L  |  M  |  H 

L  |  M  |  H 

Task 

Interarrival: 

Low 

Medium 

High 

Simultaneous 

Tasks: 

Low 

Medium 

High 

For  both  organizations,  the  model  was  first  simulated  with  no  adaptation  strategy.  In  this  mode, 
each  time  the  next  function  in  a  process  is  assigned  to  an  overloaded  decision  maker,  the 
function  incurs  a  processing  delay  of  one  time  unit,  thereby  affecting  the  timeliness  of  the 
completion  of  the  process.  The  next  strategy  implemented  was  the  local  adaptation  strategy.  In 
this  mode,  each  time  the  next  function  in  a  process  is  assigned  to  an  overloaded  decision  maker, 
an  alternative  decision  maker  is  chosen.  A  processing  delay  of  one  time  unit  is  incurred  only  if 
the  alternative  decision  maker  chosen  is  overloaded  as  well.  In  global  adaptation,  if  the  next 
decision  maker  chosen  is  overloaded,  the  function  occurs  a  processing  delay  of  one  time  unit,  the 
same  as  with  no  adaptation.  However,  if  the  task  receives  a  score  of  zero  upon  completion  of  the 
process,  indicating  it  was  not  completed  in  a  timely  manner,  the  next  task  of  this  same  type  will 
be  implemented  with  the  alternative  process. 

Because  the  workload  limit,  the  total  activity  a  decision  maker  can  sustain  without  performance 
degradation,  can  not  be  calculated  analytically,  three  different  values  of  the  workload  limit  were 
used  in  the  experiment.  The  high  tolerance  level  was  determined  by  taking  the  highest  decision 
maker  total  activity  value  and  doubling  it.  The  low  tolerance  level  was  determined  by  taking  the 
lowest  decision  maker  total  activity  value  and  doubling  it,  the  medium  level  is  the  median 
between  the  two.  For  this  experiment  the  tolerance  level  values,  the  workload  limit,  were  set  as 
follows:  low  =  50,  medium  =  100,  and  high  =  150,  all  in  bits  per  symbol.  The  workload  limit 
determines  the  number  of  tasks  each  decision  maker  can  accept  in  a  processing  interval  without 
being  overloaded. 

5.2  Experimental  Results 

The  experimental  results  indicate  that  under  some  conditions,  there  are  no  significant  differences 
between  the  adaptation  strategies.  For  the  conditions  where  the  differences  in  performance  were 
significant,  the  strategy  with  the  higher  performance  can  be  identified.  The  results  are 
summarized  in  Fig.  5.  When  an  organization  does  not  experience  stress,  the  organization  with  no 
adaptation  strategy  performs  as  well  or  better  under  all  three  workload  tolerance  levels.  In  this 
case  the  decision  makers  do  not  have  the  additional  total  activity  associated  with  an  adaptation 
strategy  and  therefore  are  less  likely  to  become  overloaded.  However,  as  the  stress  on  an 


organization  is  increased,  at  low  levels  of  workload  tolerance,  the  local  adaptation  strategy 
performs  as  well  or  better  under  medium  stressed  conditions  and  out  performs  an  organization 
with  no  adaptation  strategy  under  the  most  stressed  conditions.  As  the  workload  limit  is 
increased,  increasing  the  tolerance  level,  the  local  adaptation  strategy  performs  as  well  as  no 
adaptation  strategy  under  low  and  medium  stressed  conditions,  but  the  local  and  global 
adaptation  strategies  perform  the  best  under  the  most  stressed  condition.  Finally  when  the 
workload  limit  is  at  its  maximum,  all  three  strategies  perform  usually  as  well  under  low  stress 
conditions,  however  as  the  stress  is  increased,  the  global  adaptation  strategy  performs  the  best. 
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Figure  5:  Experimental  Results 

The  numbers  in  parenthesis  under  the  adaptation  strategy  in  Fig.  5  represent  the  performance 
measure  range,  the  timeliness  percentage  values  for  the  region.  While  the  None  strategy 
outperforms  the  other  strategies  in  the  low  tolerance,  high  stress  conditions,  its  performance  is 
still  quite  low  as  indicated  by  the  range  0.2  to  0.4  of  the  tasks  completed  in  a  timely  manner.  In 
comparison,  in  the  high  tolerance,  high  stress  condition  under  the  Global  adaptation  strategy,  0.7 
to  0.8  of  the  tasks  were  completed  in  a  timely  manner. 

A  second  analysis  compared  the  performance  of  the  two  different  organizations,  as  shown  in 
Table  6.  Based  on  the  value  of  the  timeliness  percentage  performance  measure,  the  Non 
Traditional  (NTA)  organization  usually  performed  better  or  the  same  as  the  Traditional  (TA) 
organization,  where  significant  differences  exist.  This  reflects  the  balance  workload  among  the 
decision  makers  in  the  Non  Traditional  organizational  design,  indicated  by  the  total  activity 
values  of  the  individual  decision  makers.  The  balanced  workload  implies  that  the  decision 
makers  are  all  operating  under  similar  stress  conditions.  In  the  Traditional  organization,  two 
decision  makers  have  a  very  high  total  activity  value,  while  one  has  a  very  low  total  activity 
value.  This  imbalance  causes  the  performance  of  some  decision  makers  to  degrade  earlier  than 
the  others,  affecting  the  performance  of  the  entire  organization;  this  degradation  happens  earlier 
in  the  Traditional  organization  than  in  the  Non  Traditional  organization. 


Table  6:  Organizational  Structure  with  Best  Performance 


Tolerance 

Low 

Medium 

High 

Strategy 

Global 

Local 

None 

Global 

Local 

None 

Global 

Local 

None 

Low 

Stress 

NTA 

NTA 

Medium 

Stress 

NTA 

NTA 

TA 

NTA 

TA 

High 

Stress 

NTA 

NTA 

NTA 

TA 

NTA 

NTA 

NTA 

6.  Conclusions 

This  paper  reviewed  an  executable  organizational  model  which  can  be  used  to  evaluate  the  effect 
on  performance  of  different  organizational  adaptation  strategies.  The  five  stage  decision  maker 
model  is  used  to  model  the  decision  makers  within  the  organization.  The  different  roles  a 
decision  maker  may  assume  in  the  course  of  completing  different  functions  in  a  process  were 
defined.  Since  this  model  allows  the  active  algorithms  in  each  stage  to  be  defined,  the  total 
activity,  a  surrogate  for  decision  maker  workload,  can  be  calculated.  A  procedure  to  compute  a 
decision  maker’s  total  activity  based  on  the  entropy  of  the  set  of  functions  he  is  required  to 
perform  and  the  active  algorithms  in  each  of  his  stages  is  presented;  the  process  used  to  complete 
the  task  and  the  adaptation  strategy  implemented  by  the  organization  also  effects  the  total 
activity  calculation. 

By  using  entropy  to  calculate  each  decision  maker’s  total  activity,  the  impact  of  different 
functions,  processes  and  adaptation  strategies  are  reflected  in  the  value  used  to  evaluate 
overloaded  decision  makers.  As  the  number  of  different  functions  a  decision  maker  is 
responsible  for  increases,  the  number  of  task  processing  algorithms  he  must  maintain  increases. 
The  total  activity  value  also  includes  the  overhead  due  to  adaptation  strategy.  Both  local  and 
global  adaptation  increase  the  number  of  functions  assigned  to  each  decision  maker:  local 
adaptation  includes  backup  functions  and  global  adaptation  adds  functions  present  in  alternative 
processes.  Both  strategies  affect  the  final  output  of  the  decision  maker:  global  adaptation  forces 
the  decision  maker  to  maintain  the  rulebase  of  alternative  process  for  use  in  the  next  function 
selection,  while  local  adaptation  requires  secondary  decision  maker  information  for  use  in  the 
next  decision  maker  selection. 

Because  different  combinations  of  the  three  variables  function,  process,  and  adaptation  strategy 
may  lead  to  different  conclusions  as  to  which  strategy  is  more  effective,  organizational  model 
should  be  used  to  evaluate  the  alternative  strategies  for  particular  organizational  designs.  A 
virtual  experiment  was  conducted  using  data  from  recent  subject  experiments  in  order  to  evaluate 
the  different  adaptation  strategies  on  two  different  organizations:  one  with  a  balanced  workload 
and  one  without.  The  model  was  configured  to  each  organization  and  simulated  with  scenarios 
that  stressed  the  organizations.  The  simulation  results  indicate  that  the  global  adaptation  strategy 
was  most  effective  under  high  stress  and  high  workload  tolerance  conditions,  and  the 
organization  with  balanced  workload  generally  performed  better. 
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